MAX-RELAXATION ITERATION PROCEDURE FOR BUILDING 
OF BARABANOV NORMS: CONVERGENCE AND EXAMPLES 



Victor Kozyakin 

Institute for Information Transmission Problems 
Russian Academy of Sciences 
Bolshoj Karetny lane 19, Moscow 127994 GSP-4, Russia 



Abstract. The problem of construction of Barabanov norms for analysis of 
properties of the joint (generalized) spectral radius of matrix sets has been dis- 
cussed in a number of publications. In 18 20 the method of Barabanov norms 
was the key instrument in disproving the Lagarias-Wang Finiteness Conjecture. 
The related constructions were essentially based on the study of the geomet- 
rical properties of the unit balls of some specific Barabanov norms. In this 
context the situation when one fails to find among current publications any 
detailed analysis of the geometrical properties of the unit balls of Barabanov 
norms looks a bit paradoxical. Partially this is explained by the fact that Bara- 
banov norms are defined nonconstructively, by an implicit procedure. So, even 
in simplest cases it is very difficult to visualize the shape of their unit balls. 
The present work may be treated as the first step to make up this deficiency. 
In the paper an iteration procedure is considered that allows to build numer- 
ically Barabanov norms for the irreducible matrix sets and simultaneously to 
compute the joint spectral radius of these sets. 

1. Introduction. Let srf = {Ai, . . . , A r } be a set of real mx m matrices. As 
usual, for n > 1, let us denote by s/ n the set of all n-products of matrices from si ; 
si° = /. For each n > 1, define the quantity 

p„(sf) := max^ p(A in ■ ■ ■ A i2 A h ), 

where maximum is taken over all possible products of n matrices from the set s/, 
and p(-) denotes the spectral radius of a matrix, that is the maximal magnitude of 
its eigenvalues. Clearly, if n > r then some matrices in the product Ai n ■ ■ ■ Ai 2 Ai 1 
will occur several times. The limit 

p(s/) := limsup(p„( 1 e/)) 1/ ™ 

n— >oo 

is called the generalized spectral radius of the matrix set s/ 9j[TT] . 

Similarly, given a norm || • || in K m , for each n > 1, define the quantity 

p n (s/) := max \\Ai ■■■A i2 A il \\, 
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where ||A||, for a matrix A, is the matrix norm generated by the vector norm || • | 
in R"\ that is \\A\\ = aup M=1 \\Ax\\. Then the limit 

p(^):=\imsnp(p n (^)) 1/n (1) 

n— >oo 

does not depend on the choice of the norm | • | and is called the joint spectral radius 
of the matrix set srf [32. When r = 1 this definition coincides with the famous 
Gclfand formula for the spectral radius of a matrix [13 as in this case stf = {^4} is 
a singleton matrix set and p n {^) = \ \A n \\. 

For matrix sets si consisting of a finite amount of matrices, as is our case, the 
quantities p(s/) and p(s/) coincide with each other 5 and their common value is 
denoted as 

pK) := p{sf) = p{gf), 

while the quantities p n {&/) and p n (s/) form lower and upper bounds, respectively, 
for the joint/generalized spectral radius: 

p n (sd) < p{si) = p{si) < p n (£f), Vti>0. 

This last formula may serve as a basis for a posteriori estimating the accuracy of 
computation of p(s/). The first algorithms of a kind in the context of control theory 
problems have been suggested in 6 , for linear inclusions in [2 , and for problems 
of wavelet theory in [8-10 . Later the computational efficiency of these algorithms 
was essentially improved in 14,25 . Unfortunately, the common feature of all such 
algorithms is that they do not provide any bounds for the number of computational 
steps required to get desired accuracy of approximation of p(s/). 

Recently, in [19 explicit computable estimates for the rate of convergence of the 
quantities HA"!! 1 /™ to p(A) end their extension to the case of the joint spectral 
radius were obtained. Probably, these results will help to make more constructive 
the problem of evaluating of p(s/) by the generalized Gelfand formula (1) . Some 
works suggest different formulas to compute p(s/). So, in [7 it is shown that 

p(&f) = limsup max |tr(A, n • • • A i2 AjJI 1 ^™ , 

where, as usual, tr(-) denotes the trace of a matrix. 
Given a norm || • || in M m , denote 

ll.fi/ll := max Mil. 

Then the spectral radius of the matrix set si can be defined by the equality 

p(^)=inf|K||, (2) 

where infimum is taken over all norms in M. d 12,32 , and therefore 

p(*0 < IMI 

for any norm || • || in M. m . For irreducible matrix sets. 1 the infimum in (2) is attained, 
and for such matrix sets there are norms |j • || in K m , called extremal norms, for 
which 

IMI < p(*0. (3) 



X A matrix set .s/ is called irreducible if the matrices from si have no common invariant sub- 
spaces except {0} and R m . In 22 24 such a matrix set was called quasi-controllable. 
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In analysis of the joint spectral radius ideas suggested by N.E. Barabanov [2HI3 
play an important role. These ideas have got further development in a variety of 
publications among which we would like to distinguish 34J. 

Theorem 1.1 (N.E. Barabanov). Let the matrix set = {Ai, . . . , A r } be irre- 
ducible. Then the quantity p is the joint (generalized) spectral radius of the set si 
iff there is a norm \\ ■ \\ in W 71 such that 



Throughout the paper, a norm satisfying (4) will be called a Barabanov norm 
corresponding to the matrix set . Note that Barabanov norms are not unique. 

Similarly, as is shown in [30, Thm 3.3] and [31 , the value of p equals to p(s/) if 
and only if for some central-symmetric convex body 2 S the following equality holds 



where conv(-) denotes the convex hull of a set and pS := {px : x <G S}. As is noted 
in [30J, the relation (5) was proved by A.N. Dranishnikov and S.V. Konyagin, so it 
is natural to call the central-symmetric set S the Dranishnikov-Konyagin-Protasov 
set. The set S can be treated as the unit ball of some norm || • |j in M. d (recently 
this norm is usually called the Protasov norm). Note that Barabanov and Protasov 
norms are the extremal norms, that is they satisfy the inequality (3). In [27,28,35 
it is shown that Barabanov and Protasov norms are dual to each other. 

Remark that formulas (3), (4) and (5) define the joint or generalized spectral 
radius for a matrix set in an apparently computationally nonconstructive manner. 
In spite of that, namely such formulas underlie quite a number of theoretical con- 
structions (see, e.g., 1, 18, 20, 26, 34, 35 J and algorithms [29^ for computation of 



Different approaches for constructing Barabanov norms to analyze properties 
of the joint (generalized) spectral radius are discussed, e.g., in [15,17 and 33, 
Sect. 6.6]. In 18, 20^ the method of Barabanov norms was the key instrument 
in disproving the Lagarias-Wang Finiteness Conjecture. The related constructions 
were essentially based on the study of the geometrical properties of the unit balls 
of some specific Barabanov norms. In [16,17 the method of extremal polytope 
norms was the key tool in investigation of the finiteness properties of pairs of 2 x 2 
matrices. 

In this context the situation when one fails to find among current publications 
any detailed analysis of the geometrical properties of the unit balls of Barabanov 
norms looks a bit paradoxical. Partially this is explained by the fact that Barabanov 
norms are defined nonconstructively, by an implicit procedure. So, even in simplest 
cases it is very difficult to visualize the shape of their unit balls. The present work 
may be treated as the first step to make up this deficiency. 

In the paper, an iteration procedure is considered that allows to build numerically 
Barabanov norms for the irreducible matrix sets and simultaneously to compute the 
joint spectral radius of these sets. A similar iteration procedure is also discussed 
in [21]. 

The structure of the paper is as follows. In Introduction we give basic definitions 
and present the motivation of the work. In Section 2 the main iteration procedure 



P\\x\ 



max ||j4jx| 



(4) 




(5) 



pK). 



2 The set is called body if it contains at least one interior point. 
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is introduced and Main Theorem stating convergence of this procedure is formu- 
lated. The iteration procedure under consideration is called the max-relaxation 
procedure since in it the next approximation to the Barabanov norm is constructed 
as the maximum of the current approximation and some auxiliary norm. In Sec- 
tion 3 proof Main Theorem is given. In Section 4, to build simplest examples, 
the max-relaxation scheme is adapted for computations with 2x2 matrices. Re- 
sults of numerical tests are illustrated by two examples. In Section 5 we present 
the MATLAB code illustrating computations in Example 2. At last, in concluding 
Section 6 we discuss some shortcomings of the proposed approach and formulate 
further unresolved problems. 

2. Max-relaxation iteration scheme. Given r, m > 1, let si = {A\, . . . , A r } be 
an irreducible set of m x to real matrices. 

Throughout the paper, a continuous function j(t,s) defined for t,s > and 
satisfying 

7(i, t) = i, min{£, s} < "f(t, s) < max{£, s} for t ^ s, 
will be called an averaging function. Examples for averaging functions are: 

l{t,s) = — — , y(t,s) = Vts, 7(f,s) = — — . 

2 t + s 

Given some averaging function 7(-, •)> a norm || • ||o in R m , and a vector e S K m 
such that 1 1 <s 1 1 o = 1, construct recursively the norms || • ||„ and || • ||°, n = 1,2, . . ., 
in accordance with the following rules: 

MR1: if the norm \\ ■ ||„ has been already defined compute the quantities 

, max, ||Aix|| n _ . maxi ||Aix||„ _ , 

Pn = max ij-fi , p n = mm — , 7 „ = 1 {p n , pi ; 6) 

||a:||„ x^o \\x\\„ 

MR2: define the norms \\ ■ \\ n +i and || • ||° +1 : 

||x||„+i = max j||a;||„, ^ max || Aix|| n | , (7) 

\Ml+i = IWUi/IMUi. (8) 

Remark that the number of operations needed to perform one step of algorithm 
MR1-MR2 is of order rm 2 i'(e), where v(e) is the number of operations needed 
to compute, for an arbitrary vector x £ K m , the value of the norm ||x|| with a 
relative accuracy e. In general, the value v(e) is of order e~ m . So, the total number 
of operations needed to perform n steps of algorithm MR1-MR2 has the same 
rate of growth as nrm 2 e~ m . Remark also, that the procedure (6) of calculation of 
p^ resembles the technique of iterative approximation of the joint spectral radius 
suggested in [14 . 

Main Theorem. For any irreducible matrix set s4 , nonzero vector e £ K m , initial 
norm || • || . and any averaging function j(t,s), the sequences {p^} constructed by 
the iteration procedure MR1, MR2 converge to p(stf), and the sequence of norms 
|| • ||„ converges uniformly on each bounded set to some Barabanov norm \\ ■ \\* of the 
matrix set si . Moreover, the sequence {p~} is nondecr easing, the sequence {p^} is 
nonincreasing, and 

Pn < p{&) < Pi 

for all n = 1,2, ... , which provides an a posteriori estimate for the computational 
error of p(s/) . 
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3. Proof of Main Theorem. Let us suppose that we managed to prove the fol- 
lowing assertions: 

Al: the sequences {p^} and {p~} are convergent; 

A2: the limits of the sequences {p^} and {p~} coincide: 

p = lim p+ = lim p~; 

n— J-oo n— >oo 

A3: the norms \\ ■ ||° converge pointwise to a limit \\ ■ \\* . 

Then the function || ■ ||* will be a semi- norm in W". Moreover, by (8) each norm 
|| • ||° meets the normalization condition Hell" = 1, and hence 

||e|p= lim ||e||° = 1, 

which implies ||x||* ^ 0. Note also that due to (8) the norms || • ||° differ from || • ||„ 
only by numerical factors. Therefore, the quantities p^ can be defined as 

, max, ||A,x||° _ max, ||Ajx||° 
pZ — max , p = mm . (9) 

x#0 11x11° Fn *#0 ||x||° V ' 

Then, passing to the limit in (9), one can conclude that the semi- norm ||x||* satisfies 
the Barabanov condition 

p||x||* = max || Ajx||*. 

i 

But as shown in [20, Thm. 3], any semi-norm ||x||* ^ satisfying the Barabanov 
condition for an irreducible matrix set is a Barabanov norm. 

Thus, under assumptions Al, A2 and A3, the iteration procedure (6)-(8) allows 
to build a Barabanov norm and to find the joint spectral radius of the matrix set 
si. 

So, to complete the proof of Main Theorem we need to justify assertions Al, 
A2 and A3 which will be done in Sections 3.1-3.6. In Section 3.1 we establish 
convergence of the sequence of norms {|| • ||°} to some limit which allows to prove in 
Lemma 3.2 that Assertion A3 is a corollary of Assertions Al and A2. Section 3.2 
demonstrates that the quantities {p~} form the family of lower bounds for the 
joint spectral radius p of the matrix set while the quantities {p^} form the 
family of upper bounds for p. In Section 3.3 we prove that the sequences {p„ } are 
bounded and monotone which implies the existence of the limits p~ = lim„_ i . 00 p~ 
and p + = lim n _ i . 00 p+. At last, in Sections 3.4 and 3.5 we prove that p~ = p + which 
allows to justify in Section 3.6 the validity of Assertions Al and A2 and thus to 
finalize the proof of Main Theorem. 

3.1. Convergence of the sequence of norms {|| • ||°}. Given a pair of norms 
|| • ||' and || • ||" in M m define the quantities 

e-dMIMMn^in^, e + (||.|r ) ||. r) =maxK. (10) 

Since all norms in M. m are equivalent to each other, the quantities e _ (|| ■ ||', || • ||") 
and e + (|| • [|' ; || • ||") are correctly defined and 

< e-(|| • HMI • ID < e+(|| • ||M| • ||") < oo. 

Therefore the quantity 

ecc(iMiMi-ir)= :i;jj;jj;;||;jji; >i. (»> 
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which is called the eccentricity of the norm || • ||' with respect to the norm || ■ ||" 
(see, e.g., 35 ), is also correctly defined. 

Lemma 3.1. Let \\ ■ \\* be a Barabanov norm for the matrix set trf ' . Then 

ecc(|| X J T) = ecc(|| • U n , |l • II*), V n, (12) 
and the sequence of the numbers ecc(|| • ||„, || • ||*) is nonincr easing. 

Proof. Note first that by (8) each norm |j ■ ||° differs from the corresponding norm 
|| • |j„ only by a numerical factor. From this, by the definition (10), (11) of the 
eccentricity of one norm with respect to another, the equality (12) follows. 

Denote by p the joint spectral radius of the matrix set si '. Then, by definitions 
of the function e + (-) and of the Barabanov norm || ■ ||*, from (6), (7) we obtain: 

||a;||„ + i = max|||a;||„, 7" 1 max || A^jl,,} < 

<e+(|| J n ,||-f)max{H*, ^ max \\Aix\\* } = 

= e+ (ll ' \U, II ■ |r)max{N|*, 7nVlkH*} • 

Therefore 

e + (M|n + i,||-|r)<e + (||.|| n ,||.|r)max{l, 7 "V} . (13) 

Similarly, by definitions of the function e~(-) and of the Barabanov norm || • ||*, 
from (6), (7) we obtain: 

||x||„ + i = max|||a;||„, 7" 1 max ||A;a;||„j > 

> e_ (ll ' ll« -II ' ir)max{||x||*, 7 - 1 max||A i .T||*} = 

= e -(||-||„,||-|r)max{|Nr, l^pWxW*}. 

Therefore 

e-(||-||„ +1 ,||-|r)>e-(||-|| n ,||-|r)max{l, 7 " V} ■ (14) 
By dividing termwise the inequality (13) on (14) we get 

, *s e + (\\-\\n + i,\\-\n , e+(||-|| n ,||-|r) 

e (II ' lln+iJI ■ II ) e (|| ■ ||„,|| • j|*) 
Hence, the sequence {ecc(|| • ||„, || • ||*)} is nonincreasing. □ 
Denote by Ni oc (M. m ) the topological space of norms in R m with the topology of 
uniform convergence on bounded subsets of W n . 

Corollary 1. The sequence of norms {|| • ||°} is compact in Ni oc (R. m ). 

Proof. For each n and any x ^ 0, by the definition (10) of the functions e + (-) and 
e~(-) the following relations hold 



and then 



from which 



<!%< e + (HUMn, 



e-(ii-ii„,ii-ir)<^< e + (Mu,Mr), 



H|e||„<||x||„<ecc(||-||„,||-|r)|%||e|| rl . 



ccc • • r e r e 
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Since here by construction the norms {|| • ||°} satisfy the normalization condition 
Hell" = 1, and by Lemma 3.1 ecc(|| ■ ||°, || ■ ||*) < ecc(|| ■ ||g, || ■ ||*), we have 

^S<!l^!l«< ccc (Mlo,||-ir)S. 



eccui - iio, ii - ir; \\< 

Therefore the norms || • || n , n > 1, are equicontinuous and uniformly bounded on 
each bounded subset of R m . Moreover, their values are also uniformly separated 
from zero on each bounded subset of R m separated from zero. From here by the 
Arzela-Ascoli theorem the statement of the corollary follows. □ 

Corollary 2. // at least one of subsequences of norms from {|| • ||°} converges in 
Ni oc (M. m ) to some Barabanov norm then the whole sequence {\\ ■ ||°} also converges 
in N\ oc (W n ) to the same Barabanov norm. 

Proof. Let {|j • ||° fc } be a subsequence of {|| ■ ||°} which converges in A r i oc (]R m ) to 
some Barabanov norm j| ■ ||*. Then by definition of the eccentricity of one norm 
with respect to another 

ecc(|| • ||° fc ,|| • ||*) -> 1 as/c^oo. 

Here by Lemma 3.1 the eccentricities ecc(|| • ||°, || • ||*) arc nonincrcasing in n, and 
then the following stronger relation holds 

ecc(|| ■ ||°, || ■ II*) -+ 1 asn^oo. (15) 

Note now that by the definition (10), (11) of the eccentricity of one norm with 
respect to another 

— 7ii I fi ^ < fefe < ecc(|| ■ ||°, || ■ |D, 



^Ml lln< II II I II I 

from which by (15) it follows that the sequence of norms {|| • ||°} converges in space 
A loc (R m ) to the norm || • ||*. □ 

Lemma 3.2. Assertion A3 is a corollary of Assertions Al and A2. 

Proof. By Corollary 1 the sequence of norms {|| • ||°} has a subsequence {|| ■ ||° } 
that converges in space Ai oc (R m ) to some norm || • ||*. Then, passing to the limit 
in (9) as n, = rife — !• oo, we get by Assertions Al and A2: 

max, \\Ajx\\* 

INI 

which means that || • ||* is a Barabanov norm for the matrix set This and 
Corollary 2 then imply that the sequence {|| • ||°} converges in space Ai oc (R m ) to 
the Barabanov norm || • ||*. Assertion A3 is proved. □ 
So, in view of Lemma 3.2 to prove that the iteration procedure (6)-(8) is con- 
vergent it suffices to verify only that Assertions Al and A2 hold. 

3.2. Relations between and p. The following lemma provides a way to esti- 
mate the spectral radius of a matrix set. 

Lemma 3.3. Let a, (3 be numbers such that in some norm |j • || the inequalities 

ct\\x\\ < max ||Aj3;|| < /3\\x\\, 

hold. Then a < p < fi, where p is the joint spectral radius of the matrix set 
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Proof. Let || • ||* be some Barabanov norm for the matrix set srf. Since all norms 
in K m are equivalent, there are constants o~ > and a + < oo such that 

tr~\\x\\* < \\x\\ <a + ||x||*. (16) 

Consider, for each k = 1,2,..., the functions 

Afe(x) = max \\A lk . . . A l2 A h x\\. 

l<i 1 ,i 2 ,...,i k <r 

Then, as is easy to see, 

a k \\x\\ < A k (x) <l3 k \\x\\. (17) 
Similarly consider, for each k = 1, 2, . . ., the functions 

Afc(ar)= . max || A lfc . . . A l2 A 4i .t||*. 

For these functions, by definition of Barabanov norms the following identity hold 

At(x) = p k \\x\\*, (18) 

which is stronger than (17). 

Now, note that (16) and the definition of the functions Afc(x) and A£(x) imply 

a-A* k (x) < A k (x) < a+A£,(x). 

Then, by (17), (18), 

£Z a * < < fl^, V fc, 

(7+ (7 

from which the required estimates a < p < (3 follow. □ 
So, Lemma 3.3 and the definition (6) of p^ imply that the quantities {p~} form 
the family of lower bounds for the joint spectral radius p of the matrix set srf , while 
the quantities {p^} form the family of upper bounds for p. This allows to estimate 
a posteriori errors of computation of the joint spectral radius with the help of the 
iteration procedure (6)-(8). 

3.3. Convergence of the sequences {p^}- Estimate the value of max^ ||j4jx|| n +i. 
By definition, 

max || j4ix||„+i = max < max < ||j4,x|| n , j~ max || ^4, A^xH^ 

= max < max || Ajx||„, y~ maxmax ||AiAj-x||„ 

[ i j i 

Here by the definition (6) of the quantities p~ the right-hand part of the chain of 
equalities can be estimated as follows: 

p~max j||x||„, 7- 1 max||A,-x||„j < 

< max < max ||Ajx|| n , 7~ maxmax || Aj.Ajx|| n > < 

I i 3 i J 

p+ max |||x||„, 7" 1 max \\Ajx\\ 

Therefore, by definition of the norm ||x|| n +i, 

/0~||x|| n+ i < max||^x|| n+ i < p+||x||„ + i, 
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from which 

_ max* m^Hn+i + 

IfII«+i 

and then, 

Pn < Pn+l < Pn+l < Pn ■ 

So, the following lemma holds. 

Lemma 3.4. The sequence {p^} is bounded from above by each member of the 
sequence {p^} and is nondecreasing. The sequence {p„} is bounded from below by 
each member of the sequence {p~} and is nonincreasing. 



In view of Lemma 3.4 there are the limits 

p~ = lim p~, p + = lim p+, 7 = lim j n = lim 'y(p~,pt), 



~i' lmr p"^~ 1 1 lim r\l ( n n ' ^ 

n— >oo 

where 

P~ < 7 < P + , 

which means that Assertion Al holds. Hence, to prove that the iteration procedure 
(6)-(8) is convergent it remains only to justify Assertion A2: p~ = p + . 

To prove that p~ = p + , below it will be supposed the contrary, which will lead 
us to a contradiction. 

3.4. Transition to a new sequence of norms. To simplify further constructions 
we will switch over to a new sequence of norms for which the quantities p^ will be 
independent of n. 

By Corollary 1 the sequence of the norms || • ||° is compact in space iVi oc (R m ). 
Hence, there is a subsequence of indices {n^} such that the the norms || ■ ||° = 
II ' l|rafc/ll e IUjt converge to some norm || • ||q satisfying the normalization condition 
|je||J = 1. Then, passing to the limit in (9), by Lemma 3.4 we obtain: 

, maxi ||A !; x||o _ maxi ||A:^|lo / - + x 

Now by induction the following statement can be easily proved. 

Lemma 3.5. For each n = 0,1,2,..., the sequence of the norms j ■ ||n fc +n/||e|| nfc 
converges to some norm \\ ■ ||*. Moreover, for each n = 0,1,2,..., we have the 
equalities 

max, \\Ajx\\Z + . max, \\A lX \\' n _ 
max — = p , mm 77— T . = p , (19) 

and the recurrent relations 

\\x\\l +1 =m^{\\xW n , 7 - 1 max||A-a||'}. (20) 

3.5. Sets u n . Define, for each n = 0, 1, 2, . . ., the set 

w„={xe R m : p-\\x\\' n = maxllA^II,*} . (21) 

By (19) uj n is the set on which the quantity 

maxj ||Ajx|l* 
INI* 

attains its minimum. 

Lemma 3.6. If x E w n then \\x\\' l+1 = ||x||*. 
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Proof. The statement of the lemma is obvious for x = 0. So, suppose that x € u! n , 
x 7^ 0. In this case (21) and the inequalities p~ < p + imply 

maxHA^Ij* =p-|N|:< 7 ||z|i; 

or, what is the same, 

||z||* > 7~ 1 max||A l x||;. 
From here by the definition (20) of the norm || • ||* +1 we get the required equality: 

IMIn+i = max {lMln; 7 _1 max|jA ia ;||;| = 

The lemma is proved. □ 

Lemma 3.7. // p~ < p + then Lo n +\ C uj n for each n = 0, 1, 2, . . .. 

Proof. Let x € u} n +i- If a; = then clearly x € w n , so suppose that x ^ 0. By 
definitions of the set w„+i and of the norm || ■ ||* the following equalities take place: 



max || Ajxj|* +1 = max |max ||| A,x||* , 7 1 max || AjAjx||* 

= max < max || Ajx||* , 7 _1 max || AjAjx|j* > = 
t i id J 

= P~IM|* + i = P _ max|||x||*, j' 1 max j| A,x||' j . (22) 

Let here 

||x||: <7" 1 max||A l x!| r '. (23) 
Then from ( 22) it follows that 

max^ max||Ajx||*, 7 _1 max || Aj-Ajx||* > = /0~||x||* +1 = -f~ 1 p~ max ||Ax||* . 

^ % t,j j % 

But by the conditions of the lemma p~ < p + . Then 7 = j(p~ , p + ) > p~ , and the 
right-hand part of the above equalities is strictly less than max^ ||Ajx||*. A contra- 
diction, since the left-hand part of the same equalities is no less than max^ ||A;x||* . 

The above contradiction is caused by the assumption (23), and therefore it is 
proved that the condition x 7^ G uj n +i implies the strict inequality 

\\A\n > 7 _1 max||A l x||;. 
In this case from ( 22 ) it follows that 



max <^ max \\Aix\\' n , 7 max HA^xH' \ = p \\x\\'. (24) 

Let us show that the equality (24) implies 

max\\A i xW n = p-\\xW n . (25) 

Indeed, supposing the contrary, by definition of the quantity p~ , there should be 
valid the strict inequality maxj ||A,x||* > p _ ||x||*. Then the left-hand part of the 
equality (24) should be strictly greater than p~||x||*, that is greater than the right- 
hand part of the same equality, which is impossible. This last contradiction shows 
that the equality (25) holds as soon as x 7^ € w n +i, which means by (19) that 

x € LJ n . □ 
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Corollary 3. If p < p + then oj := n n >ow„ ^ and 

NIS = HI = -" = l|aC = -.-, Vx/Oe,. (26) 

Proof. By Lemma 3.7 {w„} is the family of embedded closed conic 3 sets. Then the 
intersection ui of these sets is also a closed conic set such that u ^ {0}. 

By definition of the set u>, if x € uj then x € w„ for every integer n > 0. Hence, 
by Lemma 3.6 ||x||* + i = from which the equalities (26) follow. □ 

3.6. Completion of the proof of Assertion A2. By Corollary 3 there is a non- 
zero vector g on which all the norms || • ||* take the same values: 

Nis = Ni; = ••• = « = •••■ 

Then, due to uniform boundedness of the eccentricities of the norms || • ||* with 
respect to some Barabanov norm || ■ || * (this fact can be proved by verbatim repetition 
of the analogous proof for the norms || • || ra ), the norms || • ||* form a family which is 
uniformly bounded and equicontinuous with respect to the Barabanov norm || • ||*: 

3^6(0,00): n-\\x\\*<\\x\\ m n <n + \\x\\\ n = 0,l,2,.... 

Hence, by the Arzela-Ascoli theorem the family of norms {|| ■ ||*} is compact in 
Moc(K m )- 

From the definition (20) of the norms || • ||* it follows also that 



:{||a;||*, 7 1 max||A t x||*| 



> \\x\\l. 



Then the norms || • ||* are monotone increasing in n and bounded (with respect to 
the Barabanov norm || ■ ||*) and therefore they pointwise converge to some norm 
|| • ||*. Moreover, since the family of norms {|| ■ ||*} is equicontinuous with respect 
to the Barabanov norm || • ||*, the norms || • ||* converge to the norm || • ||* in space 
Moc(K m ). 

Now, passing to the limit in the relations 

= max {lkll* 5 7 _1 niax||Aix||'| > 7 _1 max || A iX \\' n , 
which follow from (20), we obtain 

\\x\\' > 7 _1 max||A ^ a;||•. 

i 

From here 

max,- II Axil* 

max "„ 11 < 7. 27 

\\xW ~ ' 1 ' 

On the other hand, passing to the limit in the first relation of (19), we obtain 

max,- ||Air||* , 

max , "„ 11 = p + . 28 

x^o \\x\\* v ' 

Relations (27) and (28) imply the inequality p + < 7 which contradicts the as- 
sumption p~ < p + because by definition of the function ■) the condition p~ < p + 
implies the inequality 7 = r y(p~,p + ) < p + . 

The obtained contradiction completes the proof of the equality p~ = p + as well 
as of the convergence of the iteration procedure (6)-(8). 



3 A set X is called conic if together with each its point x it contains the ray {tx : t > 0}. 
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4. Computational scheme for 2x2 matrices. Let = {Ai, . . . , A r } be a set 

of real 2x2 matrices 



M „(<) 



11 


«12 


w 

21 


(*) 
a 22 



A, = 



Let (r, 99) be the polar coordinates in R 2 . Then, for a vector x £ K 2 with 
Cartesian coordinates a; = {xi,X2j-, we have 

x = {r cos if, r sin 93} 

and 

r = r(x) = *J x\ + x|, <y3 = = arctan (x^/xi) . 
Define, for an arbitrary norm || • ||, the function 

= ||{cosv?, sin ^}||. 

Then the norm ||x|| of the vector x with polar coordinates (r,ip) is determined by 
the equality 

\\x\\=rR{<p), (29) 

and the unit sphere in the norm || • || is determined as the geometrical locus of the 
vectors x polar coordinates of which satisfy the relations 

1 



rR(tp) = 1 or r = 



r(<pY 



see Fig. 1 





• x = (r, 93) 




^^(iMI = rR(<p) 




/ i/i?(<X 


Hxll = 1 ^ rR(tp) 


= 1 J 



Figure 1. Definition of the function R(ip). 



Now, let R n (<p) be the function defining in the polar coordinates the graph of 
the unit sphere ||x||„ = 1 of the norm || • || n determined by the iteration procedure 
(6)-(8). Rewrite the relations (6)-(8) in terms of the functions Rn(<p). To do it 
we should express the quantities || -Ajx|| n , i = 0, 2, . . . , r, in terms of the functions 

Rn(<p). 

By (29.) 

||Aix|| n = r{A i x)R n (cp(A i x)). 
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Here by definition of the matrix At 

r(Aix) = rHi(<p), 

where 



Yj I \ if (i) (i). \ 2 . ( (*) . (i). V 

Hi (if) = \ [a\{ cos</3 + a 12 srntp I + I a 2 { cosLp + a 22 sin 99 I 



Similarly, by definition of the matrix Ai 

<p(A t x) = & t (tp), 

where 



$i(<p) = arctan 



a 2 { cos ip + a 22 sin 95 
a l:L costp + a 12 smip 



From the obtained relations it follows that the first two equalities in (6) take the 
form 

. HiMRnpiiip)) _ . Hi(<p)Rn(*i(<P)) 

pi = max max — — , p n = mm max — — , 

f i Rn(<p) V J Rn{f) 

or, what is the same, 

P Z = max , p n = mm (30) 

V> Rn(ip) V Rn(ip) 

where 

= maxliJ,^)]?^*^))} . (31) 

1 

The relations (7) take the form 

rRn+iiv) =max{rR n ((p), r 7 - 1 i? I * l (^)} 

or, equivalcntly, 

Rn+xicp) = max {R,M, I^KifP)} ( 32 ) 
and the normalization condition (8) takes the form 

rR n+1 (<p) = — -, — r, 

where (r e , tp e ) are polar coordinates of the vector e. Taking in place of e the vector 
with polar coordinates (1,0) the normalization condition can be rewritten in the 
form 

K + ^) = P^y 03) 

So, the max-relaxation iteration scheme can be represented as follows. Given 
an averaging function 7(-, •), set Ro(tp) = 1, and build recursively the 27r-periodic 
functions R n (ip) and R^(ip), n = 1, 2, . . ., in accordance with the following rules: 

MR1: regarding the function Rn(ip) already known compute the numerical val- 
ues P Z and p~ by formulas (30), (31) and set j n = j{PniPt)i 

MR2: define R n+ i((p) by (32) and R° l+1 (tp) by (33), and then determine the 
norm |j • as ||a;||° +1 = ri£° , i(ip), where (r,tp) are the polar coordinates 
of the vector x. 
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2 
1.5 
1 

0.5 



-0.5 

-1 
-1.5 

-2 



Pull 


= P 


- - \\A 2 x\\ 


= P 


\M\ 


= P 




= 1 




Figure 2. Examples of computation of Barabanov norms for 2x2 matrices. 



Example 1. Consider the family 



{Ai, A 2 } of 2 x 2 matrices 
, A 2 = 



The functions <&i (<p) , Hi (<p) , R n (<p) , i?* (<p) were chosen to be piecewise linear with 
3000 nodes uniformly distributed over the interval [— tt,tt]. It was needed 13 iter- 
ations of algorithm MR1-MR2 with the averaging function ^(t, s) = ^rp imple- 
mented in MATLAB to compute the joint spectral radius p(s^) with the absolute 
accuracy 10~ 3 . The computed value of the joint spectral radius is p(&f) = 1.617. 
The computed unit sphere of the Barabanov norm || • ||* after the 13th iteration of 
algorithm MR1-MR2 is shown on Fig. 2 on the left. 

As is seen from Fig. 2, in Example 1 the sets ||Aix|| = p and 11^2^11 = P have 
exactly 4 intersection points. This was theoretically proved in 18 , 20 for the case 
when one of the matrices A\,A 2 is lower triangle and the other is upper triangle, 
and their entries are nonnegative. In 18 , 20 this fact was one of key points in 
disproving the Finitcncss Conjecture. We do not know whether this fact is valid 
in a general case or not, but numerical tests based on algorithm MR1-MR2 with 
several dozens pairs of matrices A\,A 2 testify for this fact. 



Example 2. Consider the family 

A-f! IV A- 



0.8 
-0.6 



{A\, A 2 ,A 3 } of 2 x 2 matrices 
A 3 = 



0.6 
0.8 



1 
0.4 1.3 



Here the functions &i(<p), Hi(ip) , R n (ip) , R^(ip) were also chosen to be piecewise lin- 
ear with 3000 nodes uniformly distributed over the interval [— it, it]. It was needed 
31 iterations of algorithm MR1-MR2 with the averaging function j(t, s) = im- 
plemented in MATLAB to compute the joint spectral radius p{&&) with the absolute 
accuracy 10~ 3 . The computed value of the joint spectral radius is p{srf) = 1.347. 
The computed unit sphere of the Barabanov norm || • ||* after the 3 Id iteration of 
algorithm MR1-MR2 is shown on Fig. 2 on the right. 
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5. MATLAB code. Here we present the MATLAB code used for computations 
in Example 2 

'/'/, Initialization 

7 Closing of all graphs, clearing of all variables and of command 
7 window 
close all; 
clear all; 
clc ; 

commandwindow ; 

7, Specifying the number of points for the representation of the 
°/ boundary of the Barabanov norm and making it even. 
npoints=3000 ; 

npoints=2*f loor (npoints/2) ; 

7« Specifying the maximum number of iterations and the tolerance 

7 for computation of the J.S.R. 

niter=1000; 

tolerance=0.001; 

7o Specifying the pair of matrices for which the Barabanov norm 
7o and the J.S.R. are computed 
A=[1,1;0,1] ; 
B=[0.8,0.6;-0.6,0.8] ; 
C=[l,0;-0.4,1.3] ; 

7 Discretized angle array (phi) and radii array (R) to represent 
7 the boundary of the Barabanov norm in polar coordinates as the 
7o graph of the function R(phi) . 
phi=-pi : 2*pi/npoints : pi ; 
sinphi=sin(phi (2) -phi (1) ) ; 
sinphi2=sin(phi(3)-phi(l)) ; 
sinhalf =sinphi/sinphi2; 
R=ones(l ,npoints+l) ; 

7 Initialization of auxiliary variables 
rAp=ones(l ,npoints+l) ; 
nA=ones(l ,npoints+l) ; 
RA=ones(l ,npoints+l) ; 
iRA=ones(l ,npoints+l) ; 

rBp=ones(l ,npoints+l) ; 
nB=ones(l ,npoints+l) ; 
RB=ones(l ,npoints+l) ; 
iRB=ones(l ,npoints+l) ; 

rCp=ones(l ,npoints+l) ; 
nC=ones(l ,npoints+l) ; 
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RC=ones(l ,npoints+l) ; 
iRC=ones(l ,npoints+l) ; 

RABx=ones(l ,npoints+l) ; 
RABC=ones(l ,npoints+l) ; 
iR=ones(l ,npoints+l) ; 

%% Transforms in polar coordinates 

phiA=atan2(A(2, l)*cos(phi)+A(2,2)*sin(phi) ,A(l,l)*cos(phi)+. . 

A(l,2)*sin(phi)) ; 
rA=sqrt((A(l,l)*cos(phi)+A(l,2)*sin(phi)) . "2+ (A (2 , 1) *cos (phi) 

A(2,2)*sin(phi)) . ~2) ; 

phiB=atan2(B(2, l)*cos(phi)+B(2,2)*sin(phi) ,B(l,l)*cos(phi)+. . 

B(l,2)*sin(phi)) ; 
rB=sqrt((B(l,l)*cos(phi)+B(l,2)*sin(phi)) . ~2+(B(2 , 1) *cos (phi) 

B(2,2)*sin(phi)) .~2) ; 

phiC=atan2(C(2, l)*cos(phi)+C(2,2)*sin(phi) ,C(l,l)*cos(phi)+. . 

C(l,2)*sin(phi)); 
rC=sqrt ( (C (1 , 1) *cos (phi) +C (1 , 2) *sin(phi) ) . ~2+ (C (2 , 1) *cos (phi) 

C(2,2)*sin(phi)) .~2) ; 

°/o°/ Angle transformation maps 

for m=l : 1 :npoints+l 

f n=npoint s* (pi+phiA (m) ) / (2*pi) +1 ; 
nA(m)=round(fn) ; 
if (nA(m)<l) 
nA(m)=l ; 

end 

if (nA(m)>(npoints+l)) 
nA(m)=npoints+l ; 

end 

end 

for m=l : 1 :npoints+l 

f n=npoint s* (pi+phiB (m) ) / (2*pi) +1 ; 
nB(m)=round(fn) ; 
if (nB(m)<l) 
nB(m)=l; 

end 

if (nB(m)>(npoints+l)) 
nB(m)=npoints+l ; 

end 

end 



for m=l : 1 :npoints+l 
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f n=npoints* (pi+phiC (m) ) / (2*pi) +1 ; 
nC(m)=round(f n) ; 
if (nC(m)<l) 
nC(m)=l ; 

end 

if (nC(m)>(npoints+l)) 
nC (m) =npoints+l ; 

end 

end 

%% Iterative evaluation of R 

7«7o Computation of the next iteration for the norm 
i=0; 

while (Kniter) 
i=i+l ; 

for m=l : 1 :npoints+l 
rAp(m)=R(nA(m) ) ; 

end 

RA=r Ap . *r A ; 

for m=l : 1 :npoints+l 
rBp(m)=R(nB(m)) ; 

end 

RB=rBp . *rB ; 

for m=l : 1 :npoints+l 
rCp(m)=R(nC(m)) ; 

end 

RC=rCp.*rC; 

RABC=max (max (RA , RB) ,RC) ; 

7o7 Making RAB locally convex in the case when 
/o°/o computation errors caused its inconvexity 

RABx ( 1 ) =min (RABC ( 1 ) , sinhalf * (RABC (2) +RABC (npoint s ) ) ) ; 
RABx(npoints+l)=RABx(l) ; 
for m=2: 1 :npoints 

RABx (m)=min (RABC (m) , sinhalf * (RABC (m-l)+RABC(m+l ) ) ) ; 
end 

RABC=RABx ; 

srmax=max (RABC . /R) ; 
srmin=min (RABC . /R) ; 

sout=strcat('i=7„4d, Bounds for J.S.R.: 7.5. 3f < r < %5 . 3f ' ) ; 
s = sprintf (sout , i , srmin, srmax) ; 
disp(s) ; 

sr=2/ (srmax+srmin) ; 
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RX=max(sr*RABC,R) ; 

nf act=RX(npoints/2+l) ; 

R=RX/nfact; 

if (i>(niter-10)) 
hold off; 

polar (phi , srmax . /RA) ; 
hold all; 

polar (phi , srmax . /RB) ; 
hold all; 

polar (phi , srmax . /RC) ; 
hold all; 

polar (phi , 1 . /R) ; 
pause 

end 

if (abs (srmax-srmin) <tolerance) 
break; 

end 

end 

°/o°/o Drawing 

iR=l./R; 

iRA=l./RA; 

iRB=l./RB; 

iRC=l./RC; 

axRA=max ( srmax . * iRA ) ; 
axRB=max ( srmax . * iRB ) ; 
axRC=max ( srmax . * iRC ) ; 
axR=max(iR) ; 

maxR=ceil(max(max(axRA,axRB) ,max(axR,axRC))) ; 

hold off; 
axis equal; 

axis( [-maxR maxR -maxR maxR] ) ; 
hold all; 

plot ( (srmax . *iRA) . *cos (phi) , (srmax . *iRA) . *sin(phi) , ' — ' , . . . 

'Color' , [0 0]) ; 
plot ( (srmax . *iRB) . *cos (phi) , (srmax . *iRB) . *sin(phi) ,'-.',... 

'Color' , [0 0]) ; 
plot ( (srmax . *iRC) . *cos (phi) , (srmax . *iRC) . *sin(phi) , 'Color' , . . . 

[0 0]); 

plot (iR.*cos (phi) ,iR.*sin(phi) , 'LineWidth' ,2, 'Color' , [0 0]); 
legend({ ' $$\ I A_{l}x\ I ~{*}=\rho$$ ' , ' $$\ I A_{2}x\ I ~{*}=\rho$$ 

' $$\ I A_{3}x\ I ~{*}=\rho$$ ' , ' $$— \ , \ I x\ I ~{*}=1$$ '},... 

'Interpreter' , 'latex' , 'Location' , 'NorthEast') ; 
line ( [-maxR maxR] , [0 0] , ' Color ',[000],' LineStyle ',':'); 
line ( [0 0] , [-maxR maxR] , ' Color ',[000],' LineStyle ',':'); 
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6. Concluding remarks. The max-relaxation algorithm suggested in the paper 
allows to calculate the joint spectral radius of a hnitc matrix family (of arbitrary 
matrix size and arbitrary amount of matrices in the set) with any required accuracy 
and to evaluate a posteriori the computational error. Still, this algorithm gives rise 
to a set of open problems. 

Problem. While the quantities {p^} provide a posteriori bounds for the accuracy 
of approximation of p(&?) the question about the accuracy of approximation of the 
Barabanov norm \\ ■ |j* by the norms |j • ||° is open. 

It seems, the difficulty in resolving this problem is caused by the fact that in gen- 
eral the Barabanov norms for a matrix family are determined ambiguously. Namely 
to overcome this difficulty we preferred to consider relaxation algorithm instead of 
direct one. Moreover, as can be shown, both theoretically and numerically, if to set 
II^IU+i = In 1 max i H^i^lln in (7) then the obtained direct computational analog of 
algorithm MR1-MR2 may turn out to be non-convergent. 

Problem. The question about the rate of convergence of the sequences {pn} an d 
{/?"} to the joint spectral radius is also open. 

Remark also that in this paper mainly the algorithm for building of Barabanov 
norms rather than its computational details was studied. The numerical aspects of 
implementation of this algorithm require additional analysis. 

Problem. An estimation of the computational cost of the max-relaxation algorithm 
is required. The dependance of the algorithm on parameters r, m and the choice of 
the averaging function 7(t, ,s) is acute, too. 
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